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ABSTRACT 



Method and apparatus for inputting an image includes 
structure and steps for detecting whether a pick-up mode is 
a person pick-up mode or a document pick-up mode. Struc- 
ture and steps are provided for selecting a white balance 
reference value according to the detected pick-up mode. 
Stracture and steps are also provided for correcting the white 
balance of the color image using both the selected reference 
value and color information calculated from the picked-up 
color image signal. 

11 Claims, 9 Drawing Sheets 
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FIG. 3 
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JMAGE INPUT APPARATUS HAVING A 
WHITE BALANCE CORRECTION MEANS 
AND A METHOD OF INPUrTING AN IMAGE 
USING THE IMAGE INPUT APPARATUS 

BACKGROUND OF THE INVEISmDN 

1. Field of the Invention 

The present inventioa relates to an image input apparatus, 
and more particularly, to an image input apparatus for 
images of persons and documents. 

2. Description of the Related Art 

Recently, with progress in con^uters and communication 
technology, the technological base for handling images with 
computers has e^anded, and video cameras have become 
available as an image input means. For example, according 
to picture phone and videoconference systems, an image of 
a speaker or a document (such as a material of the 
conference) is input and transmitted over a distance to the 
other party. Since the provision of a separate video camera 
for the person and for the document represents a substantial 
cost a combined use of one video camera for both the person 
and the document is usually considered. 

FIG. 1 is an external view of a conventional video camera 
for images of persons and documents. Referring to FIG, 1, 
a camera head 110 is supported by a column 112 in such a 
manner that it can be directed horizontally <k vertically 
downward. Since the camera head is changed between the 
cases when a person is picked-up and when a document is 
picked-up, the camera head 110 is provided with a function 
for changing the vertically downward direction in a picked- 
up image when, for example, the camera head 110 is directed 
downward. Outputs of the camera head 110 are supplied to 
a computer 114, displayed on a monitor screen, and then 
transmitted to remote areas. 

Sudi image input apparatus and also a common video 
camera are provided with a correction circuit for automati- 
cally correcting a color balance, specifically, a white balance 
of pick-up images. In order to avoid the adverse influence of 
objects of different colors, technology is known in which the 
white balance is corrected by using only a signal from a 
white object (or of a color approaching white), or a signal 
having the potential of becoming such a signal (hereinafter, 
referred to as a white reference signal). For example, this 
technology is one in wtdch only the white reference signal 
is extracted from a luminance signal and two types of color 
difference signals R-Y and B-Y to correct a gain of each 
color component of the pick-up image in such a manner that 
the extracted color difference con^nent is allowed to 
approach zero. 

In addition, technology is known in whidi, when a person 
is picked-up, the color balance is controlled in accordance 
with the color ten^>ei:ature of a light source (such as a 
sunlight, a flu(H:escent lamp or an incandescent lan^) in such 
a manner that the extracted color difference signal compo- 
nent is allowed to approach slightly to a warm color (R-Y>0, 
B-Y<0), thcretjy faithfully reproducing a realistic image 
without fading a color of the person's sMn. 

However, when a video camera provided with the white 
balance correction circuit adjusted for picking-up the person 
is used for picking-up the document, the color of the 
document is reproduced in somewhat reddish hues. 
Conversely, according to the white balance adjusted for 
color reproduction of the document, the color of the person's 
skin is reproduced with a slight fading when the person is 
picked-up. 



SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an image 
input apparatus which enables an optimum white balance 

^ correction even when a pick-up mode is changed. 

According to an aspect of the invention, there is provided 
an image input apparatus which comprises: image pick-up 
means for converting an optical image into an electric signal 
and outputting a color image signal; calculation means for 

IQ calculating color information from the color image signal 
output from the image pick-up means; storage means for 
storing (i) a first reference value for a white balance cor- 
rection in a first pick-up mode, and (ii) a second reference 
value for a white balance correction in a second pick-up 

IS mode; selection means for selecting either of the first 
reference value and second reference value in accordance 
with the pick-up mode; and correction means for correcting 
the white balance of the color image signal with the refer- 
ence value selected in accordance with the pick-up mode 

20 and the color information calculated by the calculation 
means. 

According to another aspect of the invention, there is 
provided a method of inputting an image with an image 
input ^aratus which comprises the steps of: detecting 

25 whether a pick-up mode is a person pick-up mode or a 
dooiment pick-up mode; selecting a reference value for 
correcting a white balance of a color image signal according 
to the pick-up mode detected; and correcting the white 
balance of the color image signal with color infcxmation 

30 calculated from the color image signal included in an 
electric signal in which an optical image is converted and the 
reference value selected. 

Ftnther objects, features, and advantages of the present 
invention will become apparent from the following desa:q>- 

35 tion of the preferred embodiment with reference to the 
attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an external view of a conventional image input 
apparatus; 

FIG. 2 is a schematic diagram which illustrates an 
embodiment of the present invention; 
FIG. 3 illustrates an sample of a screen when a person 
45 is picked-up; 

FIG. 4 illustrates an example of a color difference value 
of a person's skin; 

FIG. 5 is a view which illustrates a split screen and data 
of each of the split areas of an embodiment of the present 
invention; 

FIG. 6 illustrates a change in color temperature; 

FIG. 7 in an explanatory view of a range in which a signal 
of a white object is extracted; 

55 FIG. 8 is an explanatory view of a low luminance portion 
and a colorless potion at a high luminance; 

FIG. 9 illustrates a refmnoe value of a white balance 
when a person is plcked-up; and 

^ FIG. 10 illastrates a reference value of a white balance 
when a document is picked-up. 

DETA TT^HD DESCRIPTION OF THE 
PREE^EEIRED EMBODIMENT 

65 An embodiment of the present inventioa will now be 
described in detail with reference to the accompanying 
drawings. 
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FIG. 2 is a schematic block diagram showing an embodi- and 32, and the change-of-state detection circuit 38. 
^ ^// /inent of the present inventton..Refemng.tx>.HG..2,_animage Although details will be described later, the correction signal 
/ pick-up element 14 comprised of a CCD or the like converts calculation circuit 40 changes a reference value of the white 
/ optical images (passing.throu^ri^id^uplHs lO a nd^a^ • balance when the person is picked-up and when the docu- 
electric signals. AJuniinanceli fflal'and'chromafe ment is picked-up, in accordance with the output of the 
ignal"|goducin g cifcuit~ I6 produces a high frequency state-of-change detection circuit 38. A memory 42 tempo- 
component" YH and a low frequency component YL of a ranly stores calculation results and the like of the outputs of 
^luminance"signal,^lcd"signal-R"andXbluc"signal'B"from the A/D converters 28, 30 and 32 and the correction signal 
signals"output from the~image5ickiup_:dem^'14."A gain calculation circuit 40 under control of the correction signal 
control circuit 18 controls_a_gain_of.thcjignal^^^^:thc>io calculation circuit 40. The. correction signal calculation 
Suimnance-signal-and chromaticity signal producing dfaiit circuit 40 is composed of, for example, a digital calculation 

16. A gain^contrd circuit 20 conggsjTgainof the signa l'B" ^ circuit such as a miCTOComputCT^_______ 

'from-thc-luinin mcc sifflal'and chromaticitjrs^ A. D/A converter 44 converts the R gain correction signal 

mg circuit-16. ou^ut from the caiection si^al calculation^circuit40~from 

A color difference signal producing circuit 22 produces 15 a digital value to an analog value. A D/A converter 46 
^^"difference"sipals"R-Y~and-B-Y"from the"sipal'Yir^ converts the B gain correction signal also output from the 
ou^ut~from"the^luminance'signal-and-chroniaticity-signal — ^ correction signal calculation drcuit 40 from a digital value 

\\ jrodudng circuit 16 and the outputs of the gain control to an analog value. The outputs of the D/A converters 44 and 

^ circuits 18 and 20. A video encoder 24 produces a standard 46 are applied on gain control terminals of the gain control 

type video signal from the high frequency luminance signal 20 circuit 18 and 20, respectively. 

YH output from the lununance signal and chromaticity a synchronizing signal generation circuit 48 generates a 
signal producing drcuit 16 and color difference signals R-Y signal for synchronizing the A/D converters 28, 30, 32 and 
and B- Y output from the color difference signal producing the conection signal calculation drcuit 40. The synchroniz- 
drcuit 22. An output-terminal 26 outputs the outputs of the ing signal generated from the synchronizing signal genera- 
encoder 24. 25 {Jqp circuit 40 also synchronizes with the image signal 

An A/D converter 28 converts the analog color difference output from the image pick-up element 14. 

signal B-Y output from the color difference signal producing White balance corection, which is a primary operation of 

circuit 22 into a digital signal. An A/D converter 30 converts this embodiment, will now be described. The basic operation 

the analog difference signal R-Y output from the color of the white balance correction will be described in the first 

difference signal producing circuit 22 into a digital signaL place. 

An A/D converter 32 converts the analog high frequency ^ this embodiment, the correction signal calculation 

luminance signal YH output from tiie luminance signal and 45 ^^^^^^ ^^^^^ of the A/D converters 28, 30 and 

chromatidty signal produdng circuit 16 into a digital signaL 32 into a total of 64 areas (8 areas high by 8 areas wide) 

An iris position detector 34 is composed of a Hall element within one screen, as shown in FIG. 5, in accordance with 

for detecting an opening degree of the iris 12, and outputs a the synchronizing signal output from the synchronizing 

high voltage when an ^erture is opened and a low voltage signal generation drcuit 48. In this embodiment, the ccr- 

when the aperture is dosed. rection signal calculation drcuit 40 can capture the vertical 

A person/document changeover detector 36 detects 8 areas of data per one field. Thus, it requires a period of 8 

whether a person is plcked-up, or a document is picked up. ^ fields to capture the whole data on the screen. Altiiough a 

For example, the person/document changeover detector 36 short period of time is required for capturing the whole data 

detects whether the camera head 110 Is directed horizontally on the screen, the white balance can be corrected substan- 

00* vertically downward when the image input apparatus is tially at a suffidentiy high speed even if a period of 8 fields 

constructed as shown in FIG. 1. is required as in this embodiment. 

When the person is being picked-up, the face of the 45 The conection signal calculation circuit 40 calculates tiie 

person appears on a screen substantially at the center thereof averages of the signals B-Y, R-Y and YH with respect to 

in the vertical direction, as shown in FIG. 3. Thus, by eadi of the areas and temporarily stores them in the memory 

identifying the position of the face of the person, whether or 42. As shown in FIG. 5, ttie averages of the signals B-Y and 

not the person is being picked-up can be detected. By R-Y in 64 areas are to be rq>resented by Bn (n=l to 64) and 

detecting the action of an object at each frame substantially 50 Rn (d=1 to 64), respcctivdy. Signals from a white (or of a 

at the center of tiie screen in the vertical direction, and color approadiing white) object are extracted from these 

examining the presence of a color signal corresponding to values. In light of color reproduction of the white object 

the color of the person's skin when the action stops, whether assodatcd with a diange in color temperature, a range of the 

the object is the person can be identified. For example, in the change in color teii^)eraturc will be considered along the 

case of the yellow race, if the color signal is present within 55 straight line shown in FIG. 6. As shown in FIG. 7, the 

a range of the color difference shown in FIG. 4, it can be two-dimensional coordinate system (x, y) may be consid- 

regarded as the color of the person* s skin. It is a matter of eredin which the signals R-Y and B-Y are synthesized. That 

course that radal differences such as the white, yellow and is, if we let 
black races should be considered 

A change-of-state detection circuit 38 detects dianges of 60 

states of the output of the iris position detector 34 and the and 
output of the person/document changeover detector 36, and 
notifies a correction signal calculation circuit 40 thereof. 

, A correction signal calcula tion circuit 40 calculates a the signals are less affected by the change in color tempcra- 

control valueTirc. a white"balancc_correctipn>value of the 63 ture in the y-axis direction, and arc merely changed in the 

gain~controljcircmlsI18_and_2_(Lin_^accordance with the x-axis direction according to the change in color tenq)cra- 
(^anges of sta te ofj he^outputs of the A/D converters 28, 30 



ture. 
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Thus, as distinguished by hatching in HG. 7, if only the 
signals within an area which has a fixed width and extends 
along the x-ans line are extracted, this wiU provide extrac- 
tion of all of the signals &om the white or of a color 
^roadiing white object. The use of the signals thus 
cxtra(^ achieves a control of the white balance in which 
the influence of an object of a different color is reduced. 
Specifically, only the signals having y within the range of 
b^y^a, andx within the range of c^x^d in HG. 7, and YH 
within the range of e^ YH^f in FIG. 8 are extracted. Here, 
e is a threshold for removing a low luimnance portion, and 
f is a threshold for removing a colorless portion at a high 
luminance. 

In this way, the averages Ray and Bav of Rn and Bn 
extracted as white signals from each of the areas splitting 
one screen are calculated. When determining these averages 
Rav and Bav, Rn and Bn may be previously removed if they 
are zero. In this case, Rn and Bn may be used as a basis for 
calculating the averages unless either one is zero. Of course, 
Rn and Bn obtained from all of the 64 areas may be added 
and divided by the number of the areas of 64. This method 
simplifies the calculation, but results in somewhat poor color 
reproduction. 

The correction signal calculation circuit 40 compares the 
thus obtained averages Rav and Bav with the reference 
potentials (reference values) Rref and Bref, which are 
equivalent to the averages of the signals having good white 
balance, to calculate correction data of the R signal and the 
B signal such that Rav is equal to Rref and Bav is equal to 
Bref. The calculated R correction data and B correction data 
are converted by the D/A converter 44 and 66 into analog 
signals, respectively, and applied on the control terminals of 
the gain control circuits 18 and 20 to control gains in the 
circuits 18 and 20. In this way, the gains of the R signal and 
B signal ou^ut &om the luminance signal and chromaticity 
signal producing circuit 16 are automatically controlled to 
obtain a desired color balance. 

In this embodiment, the correction signal calculation 
circuit 40 stores two values for each colcf R and B, ie. 
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Rref(l),Bref[l) and Rref(2),Bref(2) as reference values (or 40 functions. 



color of the person*s skin. The reference values Rref(l).and 
Bref(l) can be stored as line segments shown in FIG. 9 and 
a plurality of spots (numerical values). When the document 
is picked-up, the reference values Rref(2) and Bref(2) are 
allowed to com{)letely match the center point, as shown in 
FIG. 10 so that characters and pictures written on the 
document can be clearly displayed. 

As will be understood easily from the foregoing 
description, according to diis embodiment, since suitable 
values are employed as the reference values of the white 
balance when the person is picked-up and when the docu- 
ment is picked-up, respectively, it is possible to reproduce 
the color of the person's sldn in a natural state when 
picking-up the person, and reproduce a white color faithfully 
when picking-up the document Therefore, the image input 
apparatus according to this embodiment can achieve a 
suitable color reproduction when picking-up both of the 
person and document, as tiie image input apparatus for 
images of persons and documents. 

This embodiment uses the hardware configuration as 
shown in block diagram of FIG. 2. However, an image input 
apparatus according to the present invention can also be 
in^lemented in a software method in which the CPU 
performs the desired processing with a program stored in a 
storage means (memory). 

The individual components shown in outline or desig- 
nated by blocks in the Dmwings are well-known in the 
image processing arts, and their specific construction and 
operation are not critical to the operation or best mode for 
carrying out the inventioiL 

While tiie present invention has been described with 
respect to what is presently considered to be tiic preferred 
embodiments, it is to be understood that the invention is not 
limited to the disclosed embodiments. To the contrary, the 
invention is intended to cover various modifications and 
equivalent arrangements included witiiin the ^irit and scope 
of the appended claims. The scope cf the following claims 
is to be accorded the broadest interpretation so as to encom- 
pass all such modifications and equivalent structures and 



desired values) of the white valance. The change-of-state 
detection circuit 38 detects a change of the pick-up condition 
from the ou^uts of tiie person/document diangeover detec- 
tor 36 (i.e. signals showing whether a person is being 
picked-up or a document is being picked-up) and the signal 
of the iris position detector 34 detecting a change in lumi- 
nance of a pick-up screen, and notifies the correction signal 
calculation circuit 40 of the detection results. The circuit 40 
enq)loys die reference values Rref(l) and Bief(l) as the 
reference values Rref and Bref of the white balance when the 
person is picked-up, while employs the reference values 
Rref(2) and Bref(2) when the document is picked-up. 

HG. 9 shows the reference values Rref(l) and Bref(l), 
and FIG. 10 shows the reference values Rref(2) and Br€f(2). 
When the person is picked-up, the reference values Rref(l) 
and Bref(l) are changed linearly according to the color 
ten^ature of a light source. That is, when the light source 
is an artificial light such as an incandescent lamp or a 
fiuorescent lamp, an image of the object is made to appear 
in a color to whidi a slight amount of orange is added, while 
an image of the object is made to appear in a color 
approaching white when the light source is an outdoor 
natural light. This enables a color of the person's skin to be 
reparoduced in a natural state without fading. When the color 
of the person's skin is considered as described above, a 
plurality of line segments of the reference values Rref(l) and 
Bref(l) shown in FIG. 9 are prq)ared in accordance with the 
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What is claimed is: 

1. An image input s^aratus, conq^dsing: 

image pick-up means fax converting an optical image into 
an electric signal and outputttng a color image signal; 

calculation means for calculating color information from 
the color image signal output from said image pick-up 
means; 

storage means fcr staring one or more first reference 
values for a white balance ccsrection in a first pick-up 
mode, and one or more second, different, reference 
values for a white balance correction in a second 
pick-up mode; 

determining means for determining whether said appara- 
tus is in the first pick-up mode or the second pick-up 
mode; 

selection means for selecting one of said first reference 
values and said second reference values in accordance 
with tile determined pick-up mode; and 

correction means for coirecting the white balance of the 
color image signal with die selected reference value 
and the color information calculated by said calculation 
means. 

2. An image input apparatus according to daim 1, wherein 
the first pick-up mode conqirises a person pick-up mode and 
the second pick-up mode conqmses a document pick-up 
mode. 
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3. Ac image input apparatus according to claim 2, further 
comprising detection means for detectiDg whether the appa- 
ratus is in the person pick-up mode or the document pick-up 
mode. 

4. An image input ^paratus according to ciaim3, wherein 
said detection means detects a diangeover of an image 
pick-up direction of said image pick-up means between said 
person pick-up mode and said document pick-up mode. 

5. An image input apparatus according to claim 2, wherein 
said storage means stores a plurality of the first reference 
values. 

6. An image input E^paratus according to daimS, wherein 
the first reference values stored in said storage means vary 
in accordance with a color temperature of a light source. 

7. An image input apparatus according to claim 5, wherein 
the first refisrcncc values stored in said storage means vary 
in accordance with a color of a person's skin. 

8. An image input apparatus according to claim 1, fiirther 
contusing detection means for detecting whether said appa- 
ratus is in the first pick-up mode or the second pick-up mode. 

9. A method of inputting an image with an image input 
apparatus which receives an optical imagc> converts the 



optical image to an electrical signal, and calculates color 
information there&om, comprising the st^s of: 
detecting whether a pick-up mode is a person pick-up 
mode or a document pick-up mode; 
5 selecting a reference value for correcting a white balance 
of a color image signal according to the pick-up mode 
detected, a reference value for the person pick-up mode 
being different from a reference value for the document 
pick-up mode; and 
10 correcting the white balance of the color image signal 
with the color information calculated from the color 
image signal and the reference value selected. 

10. A method of inputting an image according to claim 9, 
wherein during said selecting step the reference value is 

IS further selected in accordance with a color temperature of a 
light source. 

11. A method of inputting an image according to claim 9, 
wherein during said selecting step the reference value is 
further selected in accordance with a color of a person's 

20 skin. 
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